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Abstract 

On 

In this paper, the weak convergence of impulsive recurrent process with semi- 
Markov switching in the scheme of Levy approximation is proved. Singular per- 
turbation problem for the compensating operator of the extended Markov renewal 
process is used to prove the relative compactness. 
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1 Introduction 

Levy approximation is still an active area of research in several theoretical and applied 
directions. Since Levy processes are now standard, Levy approximation is quite useful 
for analyzing complex systems (see, e.g. [HE]). Moreover they are involved in many 
applications, e.g., risk theory, finance, queueing, physics, etc. For a background on Levy 
process see, e.g. [HE1EI- 

In particular in [5] it has been studied the following impulsive process as partial sums 
in a series scheme 

u(t) 

(i) ew^+E^-i)' *^°> 

k=l 
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the random variables a £ k (x),k > 1 are supposed to be independent and perturbed by the 
jump Markov process x(t),t > 0. 

We propose to study generalization of the problem (CTJ: 

u(t) 

(2) r(*) = £ £ +E a ^-i^-i)' £ ^°- 

k=l 

Here the random variables a e k (u,x), k > 1 depend on the process £ e (t). 

We propose to study convergence of §2§ using a combination of two methods. The 
one, based on semimartingales theory, is combined with a singular perturbation problem 
for the compensating operator of the extended Markov renewal process. So, the method 
includes two steps. 

In the first step we prove the relative compactness of the semimartingales representa- 
tion of the family £ £ , e > 0, by proving the following two facts [2]: 

lim sup P{sup \C(t)\ > c} = 0, 

c->oo E < £Q t < T 

known as the compact containment condition, and 

E\e(t)-e(s)\ 2 <k\t- s \, 

for some positive constant k. 

In the second step we prove convergence of the extended Markov renewal process 
£^,x^,r^,n > by using singular perturbation technique as presented in [5]. 

Finally, we apply Theorem 6.3 from [5]. 

The paper is organized as follows. In Section 2 we present the time-scaled impulsive 
process ([2]) and the switching semi-Markov process. In the same section we present the 
main results of Levy approximation. In Section 3 we present the proof of the theorem. 



2 Main results 

Let us consider the space M. d endowed with a norm |-| (d > 1), and (E,S), a standard 
phase space, (i.e., E is a Polish space and £ its Borel cr-algebra). For a vector v G M. d 
and a matrix c G M. dxd , v* and c* denote their transpose respectively. Let Cs(lR d ) be a 
measure-determining class of real- valued bounded functions, such that g{u)/ \u\ 2 — > 0, as 
\u\ -> for g G C 3 {R d ) (see HE]). 

The impulsive processes £ e (£), t > 0, e > on M. d in the series scheme with small series 
parameter e — > 0, (e > 0) are defined by the sum (|5l Section 9.2.1]) 

(3) e(t) = e + E «*(su*s-i). *>«■ 

fc=i 
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For any e > 0, and any sequence Zk, k > 0, of elements of IR d x E, the random variables 
a e k (zk-i),k > 1 are supposed to be independent. Let us denote by G £ ux the distribution 
function of ce £ k (x), that is, 

G £ UtX (dv) := P(a%(u, x) e dv), k > 0,e > 0,x e E,u e R d . 

It is worth noticing that the coupled process £ £ (t), x £ (t), t > 0, is a Markov additive 
process (see, e.g., [5], Section 2.5]). 

We make natural assumptions for the counting process v(t), namely: 

(4) f E[(p(s)dv(s)} <h f E((p(s))ds 

Jo Jo 

for any nonnegative, increasing (p(s) and l\ > 0. 

The switching semi-Markov process x(t),t > on the standard phase space (E,£), is 
defined by the semi-Markov kernel 

Q(x, B, t) = P(x, B)F x (t),x E E, B e £, t > 0, 

which defines the associated Markov renewal process x n ,T n ,n > 0: 

Q(x,B,t) = P{x n+ i G B,6 n+1 < t\x n = x) = P(x n+ i e B\x n = x)P(6 n+1 < t\x n = x). 

Finally we should denote in (3): 



e n := £(£ 2 t„) = Co + J2 a ^-i,4-i)- 



k=l 

The Levy approximation of Markov impulsive process ([3]) is considered under the 
following conditions. 

CI: The semi-Markov process x(t),t > is uniformly ergodic with the stationary distri- 
bution 

n(dx)q(x) = qp(dx),q(x) := l/m(x),q := 1/m, 

m(x):=E6 x = / F x (t)dt,m := / p(dx)m(x), 
Jo Je 

p(B)= [ p(dx)P(x,B),p(E) = l. 
Je 

C2: Levy approximation. The family of impulsive processes £ £ (t),t > satisfies the Levy 
approximation conditions 0, Section 9.2]. 



LI: Initial value condition 



supE|^ol < C < oo 

E>0 



and 

Co =► 
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L2: Approximation of the mean values: 

a e (u;x) = / vG £ ux (dv) = eai(u;x) + e 2 [a(u;x) + 6 £ a (u;x)}, 



and 

c £ (u;x)= / vv*G e ux (dv ) = e 2 [c(u; x) + 9 £ c (u; x)], 



where functions a±, a and c are bounded. 
L3: Poisson approximation condition for intensity kernel (see [I]) 

G £ g ( U] x)= [ g(v)Gl x (dv)=e 2 [G 9 (u;x) + e £ g ( U] x)} 

for all g E C 3 (M. d ), and the kernel G g (u; x) is bounded for all g G C 3 (R d ), that 
is, 

\G g (u] x)\ < Gg (a constant depending on g). 

Here 

(5) G g (u;x)= [ g(v)G u>x (dv), geC 3 (R d ). 

The above negligible terms e a ,6 £ c , 6 e g satisfy the condition 

sup \6 £ (u; x)\ — > 0, e — > 0. 

L4: Balance condition. 

)ai(u; x) = 0. 



JE 



In addition the following conditions are used: 
C3: Uniform square-integrability: 

lim sup / vv*G ux (dv) = 0. 

C4: Linear growth: there exists a positive constant L such that 

\a(u; x)\ < L(l + \u\) , and |c(tt; a;)| < L(l + |u| 2 ), 

and for any real- valued non- negative function f(v),v 6 M ', such that J R d\r i(l + 
/(f)) |f | 2 c/f < oo, we have 

\G u , x (v)\<Lf(v)(l + \u\). 



The main result of our work is the following. 
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THEOREM 1 Under conditions CI — C4 the weak convergence 

*°(f), e^O 

takes place. 

The limit process £°(t),t > is a Levy process defined by the generator L as follows 
(6]M«) = @(«) " 2o(«)V («) + i^ 2 + A(«) / + v) - 

a{u) = q I p(dx)a(u; x),a (u) = / vG u (dv),G u (dv) = q / p(dx)G UjX (dv), 
Je Je Je 



o~ 2 (u) = 2 I n(dx){ai(u] x)R a{(u] x) + -[c(u] x) — c (u] x)]} — af(u), cr 2 (u) > 
Je 2 

A(u) = G u (R d ), G° u (dv) = G u (dv)/X(u), 

here Rq is the potential operator of embedded Markov chain. 

Remark 1. The limit Levy process consists of three parts: deterministic drift, diffu- 
sion part and Poisson part. 

There are some possible cases: 

1) . If b(u) — bo(u) = then the limit process does not have deterministic drift. 

2) . If cr 2 (w) = then the limit process does not have diffusion part. As a variant of 

this case we note that if c(u; x) = co(u; x) then also bi(u; x) — and we obtain the 
conditions of Poisson approximation after re-normation e 2 = e (see, for example 
Chapter 7 in [5]). 

Remark 2. In the work [5J (Theorem 9.3) an analogical result was obtained for 
impulsive process with Markov switching. If we study an ordinary impulsive process 
without switching, we should obtain a 2 = E(a £ k ) 2 — (E(a £ k )) 2 — (c — c ) — a\. This result 
correlates with the similar results from [3]. In case of our Theorem this may be easily 
shown, but in [5] (Theorem 9.3) it is not obvious. 

The difference is that we used Rq - the potential operator of embedded Markov chain 
instead of Rq - the potential operator of Markov process. Due to this, our result obviously 
correlates with other well-known result. 

Remark 3. Asymptotic of the second moment in the condition LI contains second 
modified characteristics c(u; x) (see correlation 4.2 at page 555 in [1]). This characteristics 
in limit contains both second moment of Poisson part and dispersion of diffusion part, 
namely c = Co + a 2 . 
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3 Proof of Theorem 1 



The proof of Theorem 1 is based on the semimartingale representation of the impulsive 
process 

We split the proof of Theorem 1 in the following two steps. 
Step 1. In this step we establish the relative compactness of the family of processes 
£, £ {t),t > 0, e > by using the approach developed in [6]. Let us remind that the space 
of all probability measures defined on the standard space (E, S) is also a Polish space; so 
the relative compactness and tightness are equivalent. 

First we need the following lemma. 

LEMMA 1 Under assumption C4 there exists a constant k > 0, independent of e and 
dependent on T , such that 

E sup |f (t)\ 2 < far- 

t<T 

COROLLARY 1 Under assumption C4, the following compact containment condition 
(CCC) holds: 

lim sup P{sup \£ £ {t)\ > c} = 0. 
Proof. The proof of this corollary follows from Kolmogorov's inequality. 

□ 



Proof of Lemma 1: (following [6j). The impulsive process ([3]) has the following semi- 
martingale representation 

(7) e(t)=u + Bt + M? 



t ■ 



where u = £q! Bf * s the predictable drift 



where 



u(t/e 2 ) 

Bt= a%e k _ 1 ,xi_ 1 )=A{(t)+A%t) + ei(t), 

k=l 

V {t/s 2 ) u{t/e 2 ) 

A\{t) :=e «i(flU4-iM e (*) := e 2 £ a(Q-i^ h -i)- 

fc=l k=l 



r - : Jm. d \\o\ 



k=l 



e 2 £ c (£*-i;4-i) + 0c(O, 



k=l 
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and for every finite T > 

sup \6 £ (t)\ -> 0,e -> 0. 

0<t<T 

To verify compactness of the process £ e (i) we split it at two parts. 
The first part of order e 

u(t/e 2 ) 
k=l 

can be characterized by the compensating operator 

L £ (p(u; x) = e~ 2 q(x)[Al(x)P - I](p(u; x), 

where A\(x)<f(u) = ip(u + eai(u; x)) = eai(u; x)<p'(u) + s9 £ tp(u). After simple calculations 
we may rewrite the operator: 

1/ = e- 2 Q + e- 1 A 1 {x)P + e E , 

here Ai(x)(p(u) = eai(u;x)<p'(u). 

Corresponding martingale characterization is the following 

A*n+1 = V(^l,n+1' X n+l) ~ VC^l.O! X o) ~ ^ V(^l,m; 

m=0 

Using the results from [5], Section 1 we obtain the last martingale in the form 

ft = <p £ (Al(t),x £ t ) + ^K(0),4) - f L e <p £ (Al(s),x £ s )ds, 

Jo 

where := x(t/e 2 ). 

Thus (see, for example Theorem 1.2 in [5]), it has quadratic characteristic 

< ^ > t = f [L £ (cp%At(s),xl)f - 2^(A £ 1 (s),x £ s )L £ ^ £ (A £ 1 (s),x £ s )] ds. 
Jo 

Applying the operator L e = e 2 Q + e~ 1 Ai(x)P + 6 s to test-function ip £ = ip + eipi we 
obtain the integrand of the view 

Qip\ - 2cp 1 Qcp 1 + 6 £ ip £ . 

Thus the integrand is limited. The boundedness of the quadratic characteristic pro- 
vides /If is compact. Thus, (p(A\(t)) is compact too and bounded uniformly by e. By the 
results from [2] we obtain compactness of A\(t), because the test-function ip(u) belongs 
to the measure-determining class. 

Now we should study the second part of order e 2 . 
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For a process y(t),t > 0, let us define the process y^(t) = sup |y(s)|, then from ((Tj) we 

s<t 

have 

(9) ((¥(m 2 < 4[n 2 + ((^(t))t) 2 + ((Mf)t) 2 ]. 

Now we may apply the result of Section 2.3 [5], namely 

u(t) 



fc=i 

Condition C4 implies that for sufficiently large £ 

'0 



-2 / n , ^/^-h 



(10) (A £ (t))t = e 2 / a(e(s), x%s))dv(s) < Le 2 I (1 + (£ e (a))t)di/(a) 

Jo Jo 

Now, by Doob's inequality (see, e.g., [TJ Theorem 1.9.2]), 

E((M £ ) f ) 2 < 4|E(M £ ) t | , 

(IE]) and condition C4 we obtain 



l(M £ ) t | 
(11) 



t/e 2 



vv*G(£ E (s) 1 dv] x £ s )dv(s) 













Jo 



t/e 2 



Le 2 



c(e(s);x £ (s))du(s) 

t/£ [i + ((fwnx* 



< 



Inequalities fl9l- ffTTl) . condition and Cauchy-Bunyakovsky-Schwarz inequality, ([/ * (p(s)ds] 2 < 

E((f (t)) f ) 2 < h + fc 2 e 2 E[((f ( S ))t) 2 ^( s )] < k! + hhe 2 [ t/£ E((C(sWds = 

Jo Jo 

h+hh rE((f( S ))t) 2 d a , 

Jo 

where fci, &2 and l\ are positive constants independent of e. 
By Gronwall inequality (see, e.g., 0, P- 498]), we obtain 

E((f(t)) t ) 2 <A; 1 exp(A; 2 / 1 t). 

Thus, both parts of £ £ (t) are compact and bounded, so 



E sup |f {t)\ 2 < k T . 

t<T 



Hence the lemma is proved. 



□ 



LEMMA 2 Under assumption C4 there exists a constant k > 0, independent of e such 
that 

E\e(t)-e(s)\ 2 <k\t- s \. 

Proof. In the same manner with (Q, we may write 

mt) - e( S )i 2 < m - bi\ 2 + i\mi - 

By using Doob's inequality, we obtain 

E|f(t) - e(s)\ 2 < 2E{\B! - Bl\ 2 + 8 \{M £ ) t - (M £ ) s \}. 

Now (TTTj) and condition (J3J) and assumption C4 imply 

\Bt - Bff + 8 \(M^) t - (M^) s \ < k 3 [l + ((e(T))t) 2 ]|t - s |, 

where ^3 is a positive constant independent of e. 

From the last inequality and Lemma 1 the desired conclusion is obtained. 

□ 

The conditions proved in Corollary 2 and Lemma 2 are necessary and sufficient for 
the compactness of the family of processes £ e (£), t > 0, e > 0. 

Step 2. At the next step of proof we apply the problem of singular perturbation to the 
generator of the process £, £ (t). To do this, we mention the following theorem. Cq (M. d x E) is 
the space of real-valued twice continuously differentiable functions on the first argument, 
defined on M. d x E and vanishing at infinity, and C(M d x E) is the space of real- valued 
continuous bounded functions defined on IR d x E. 

THEOREM 2 (J^ Theorem 6.3]) Let the following conditions hold for a family of 
Markov processes ^ e (t),t > 0,e > 0: 

CD1: There exists a family of test functions ip £ (u,x) in C$(R d x E), such that 

lim (p 6 (u, x) = <p(u), 

uniformly on u,x. 

CD2: The following convergence holds 

lim L £ (p £ (u, x) = h(p(u), 

uniformly on u,x. The family of functions h e (f 6 ,e > is uniformly bounded, and 
L<p(u) and L £ (p £ belong to C(R d x E). 
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CD3: The quadratic characteristics of the martingales that characterize a coupled Markov 
process £, £ (t),x £ (t),t > 0,e > have the representation ([i £ ) t = f^( £ (s)ds, where 
the random functions ( £ ,e > 0, satisfy the condition 



sup E|C £ (s)| < c < +00. 

0<s<T 

CD4: The convergence of the initial values holds and 

supE|C e (0)| < C < +00. 

Then the weak convergence 

e^O, 

takes place. 

We consider the the extended Markov renewal process 

(12) eX,<,n>0, 

where x £ n = x £ {r^),x £ {t) := x{t/e 2 ),£ £ n = <f (r=) and r £ +1 = r F n + e 2 6 £ n , n>0, and 

P(e £ n+1 <t\x £ n = x) = F x (t) = P(6 x <t). 

DEFINITION 1 /5J/ The compensating operator 1/ of the Markov renewal process [W\! 
is defined by the following relation 

L^Ko^o^o) = g(xo)E[y?(£i,xi,ri) - <p(f%, x , t )|.Fo], 

where 

T t := a^ £ (s),x £ (s),r £ (s);0 < s <t). 

Using Lemma 9.1 from [5] we obtain that the compensating operator of the extended 
Markov renewal process from Definition 1 can be defined by the relation (see also Section 
2.8 in [5J) 

(13) L £ (p(u,v;x) = e~ 2 q(x) / P(x,dy) G £ ux (dz)p(u + z,v;y)- 

<p(u,v;x)\ . 

By analogy with [SJ Lemma 9.2] we may prove the following result: 
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LEMMA 3 The main part in the asymptotic representation of the compensating operator 
n~3\) is as follows 

L £ <f(u, v, x) = e~ 2 Q(p(-, ■, x) + e~ l ai(u\ x)Q ip' u (u, •, •) + [a(u; x) - a (u; x)]Q tp' u (u, ■, •) + 
^[c(u; x) - c (u; x)]Q <f'i u {u, ■, •) + G u>x Q <f(u, ■, •) 

where: 

Q Q tp(x) := q(x) / P(x,dy)ip(y),G U)X tp(u) : = / [ip{u + z) - ip(u)]G u>x (dz), 



a {u;x)= / vG ux (dv),Co(u;x) 



/ vv*G UjX (dv) 

J E 



Proof of this Lemma is analogical to the proof of [HI Lemma 9.2]. 

The solution of the singular perturbation problem at the test functions (p £ (u,x) = 
(f(u) + £(pi(u, x) + £ 2 <£> 2 (w, x) in the form 

(14) LV = Ly? + 9 £ if 

can be found in the same manner with Lemma 9.3 in [Sj. 

To simplify the formula, we refer to the embedded Markov chain. Corresponding 
generator Q := P—I, and the potential operator satisfies the correlation Ro(P-I) = II— I. 

From ffl~4j) we obtain 

Q^ = 0, 
Qtpx + Ax(x)P<p = 0, 
QV? 2 + Ai(ar)Py>i + (A(ar) + C(ar) + G U)a: )P^ = m(x)L(p, 

where 

A(x)</?(w) := [a(rt; x) — a (u; x)]ip'(u), Ai(x)(f(u) := ai(tt; x)ip'(u), 

From the second equation we obtain (pi = R Ai(x)(p, and substituting it into the last 
equation we have: 

Qy3 2 + Ai(a;)P^oAi(x)v3 + (A(x) + C(x) + G u>x )ip = m(x)Lcp. 

As soon as PR® = Rq + II — / we finally obtain 

(15) q-'L = fi[(A(x) + C(x) + G^) + A 1 (x)R A 1 (x) - A?(x)]fi. 

Simple calculations give us (jSJ) from ffl5l) . 
Now Theorem 2 can be applied. 
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We see from (|T3|) and (TT5T) that the solution of singular perturbation problem for 
L £ ip £ (u, v; x) satisfies the conditions CD1, CD2. Condition CD3 of this theorem implies 
that the quadratic characteristics of the martingale, corresponding to a coupled Markov 
process, is relatively compact. The same result follows from the CCC (see Corollary 2 and 
Lemma 2) by [4]. Thus, the condition CD3 follows from the Corollary 2 and Lemma 2. 
Due to LI the condition CD4 is also satisfied. Thus, all the conditions of above Theorem 
2 are satisfied, so the weak convergence f e (t) f°(t) takes place. 

Theorem 1 is proved. 

□ 
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